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ABSTRACT 



A data processing system comprising a cache memory, 
wherein a cache entry containing data is stored in the cache 
memory. A cache coordinator, wherein the cache coordinator 
invalidates one or more cache entries in response to a signal. 
An ID -based invalidation process, wherein a cache entry is 
associated with an ID that uniquely identifies the cache entry 
and can optionally be associated with one or more data ids 
that represent the underlying data contained in the cache 
entry, and the ID -based invalidation process sends a signal 
to the cache coordinator to invalidate all cache entries that 
either have that cache entry ID or have been associated with 
a data ID when the data that the ID represents changes. A 
time-limit-based invalidation process, wherein a cache entry 
can be associated with a time limit, and the time-limit-based 
invalidation process sends a signal to the cache coordinator 
to invalidate a cache entry whose time limit has expired. A 
URI-based invalidation process, wherein all cache entries 
generated by a template with that URI are invalidated when 
that template changes. A URI is a Universal Resource 
Identifier that identifies a template that generates different 
cache entries. For example, a producl display template might 
have a URI named "productDisplayjsp" that generate a page 
for each product. The present invention integrates all of 
these methods of invalidation into a single system. 

13 Claims, 12 Drawing Sheets 
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void collPage(String url. HttpServletRequest request) 

servlet = find servlet; 
HondleFragmentlnfo(url, request, servlet); 
servlet. service(request, response); 

void hondleFrogmentlnfo(String url, 

HttpServletRequest request, 
HttpServlet servlet) 



try J 

id = servlet.getCacheldQ; 
J cotch (NoSuchMethodException e) j 
return; 

if (id == null) ) 
return; 

fragmentlnfo = new Frogmentlnfo(); 

fragmentlnfo.setld(id); 

Fragmentlnfo.setUri(url); 

request.setFrogmentlnfo(frogmentlnfo); 

return; 



FIG. 8 
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<jsp:directive.taglib uri="/xsp/tagbean/cache/taglib.xmr prefix= M coche"/> 
<cache:enoble> 

<cacheIt>!cotegoryld.equals( ,, produce")</cochelt> 

<id>"productDetail« M + productld</id> 

<pinned>false</pinned> 

<oggressiveRerender>false</aggressiveRerender> 

<externolCocheGroupld> ,, groupr , </externalCacheGroupld> 

<datoId>"product-" + productld</dotold> 
</cache:enoble> 

The equivalent JSP syntax without specialized tags would be: 
<%! public String 

C|etCacheld(comjbrn.servlet.engine.SEHttpServiceRequest request) 

return "productOetoil-" + productld; 

%> ' 



FIG. 9 



<% Fragmentlnfo fragmenting = request.getFragmentlnfo(); 
fragmentInfo.setCacheIt(!cotegoryld.equols( << produce ,, )); 
fragment I n f o.setPin (f a Ise) ; 
fragmentlnfo.setAggressiveRerender(folse); 
fragmentlnfo.setExternalCacheGroupld( ,, groupr'); 
Vector vector = new VectorQ; 
vector.addElement( M product-" + productld); 
fragmentlnfo.setDatalds(vector); 

%> 

FIG. 10 
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<?xml version="1.0"?> 
<jsp:root> 

<jsp:direclive.page errorpoge="/xsp/tesl/ errorPoge.xsp7 > 
<jsp:directive.taglib uri="/<sp/togbeon/coche/cache-toglib.xml" 
prefix="coche"/> 

<%! 

public String 

^etCocheld(com.ibm.servlet.engine.SEHttpServiceRequest request) 
return '*" + "/xsp/test/cache/publish 1 /page 1 .xsp"; 

%> ^ 
<% 

Vector vector = new Vector(); 
vector.oddElement("product-2066-4"); 
JPJQ / 7 vector.oddElement("shopperGroup-2066-2"); 

1inn Frogmentlnfo fragmenting = request.peekFrogmentInfo(); 

1 1 UU ^ frogmentlnf o.setTimeLimit(- 1 ); 

frogmentlnfo.setPin(false); 

fragrnentlnfo.setAggressiveRerender(folse); 

fragmentlnfo.setExternalCacheGroupld("group1"); 

fragmentlnfo.setDatolds(vector); 

%> 

<html> 
<heod> 

<title>Enoble JSP coching</title> 
</head> 
<body> 

<% 

System.out.println("out = " + out); 
%> 

Poge 1 colling poge 2<br/> 

<jsp:request include="/xsp/test/cache/publish1/page2.xsp"/> 
Poge 1 returning from poge 2<br/> 
</body> 
</html> 
</jsp:root> 

<?xml version=" 1.0"?> 
<jsp:root> 

<jsp:directive.toglib uri="/xsp/togbeon/coche/coche-toglib.xml" 
prefix="coche"/> 

<%! 

public String 

jetCocheld(com.ibm.servlet.engine.SEHttpServiceRequest request) 
return "" +'7xsp/test/coche/publish1/poge2.xs"; 

%> ^ 

<b>ln poge 2</bXbr/> 
</jsp:root> 
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METHOD AND APPARATUS FOR 
INVALIDATING DATA IN A CACHE 

CROSS REFERENCE TO RELATED 

APPLICATIONS 5 

The present invention is related to applications entitled 
METHOD AND APPARATUS FOR HIGH- 
CONCURRENCY CLIENT LOCKING WITH JAVA IN A 
DATA PROCESSING SYSTEM, Ser. No. 09/359,274, 
METHOD AND APPARATUS FOR MANAGING INTER- 
NAL CACHES AND EXTERNAL CACHES IN A DATA 
PROCESSING SYSTEM, Ser. No. 09/359,275, METHOD 
AND APPARATUS FOR CACHE COORDINATION FOR 
MULTIPLE ADDRESS SPACES, Ser. No. 09/359,276, 
METHOD AND APPARATUS FOR AGGRESSIVELY 
RENDERING DATA IN A DATA PROCESSING 
SYSTEM, Ser. No. 09/359,278, and A METHOD AND 
APPARATUS FOR CACHING CONTENT IN A DATA 
PROCESSING SYSTEM WITH FRAGMENT 
GRANULARITY, Ser. No. 09/359,279, all of which are filed 
even date hereof, assigned to the same assignee, and incor- 
porated herein by reference. 

BACKGROUND OF THE INVENTION 

25 

1. Technical Field 

The present invention relates generally to an improved 
data processing system and in particular to a method and 
apparatus for caching data in a data processing system. More 
specifically, the present invention relates to a method and 30 
apparatus for caching documents containing dynamic con- 
tent. 

2. Description of Related Art 

The Internet, also referred to as an "internetwork", is a set 35 
of computer networks, possibly dissimilar, joined together 
by means of gateways that handle data transfer and the 
conversion of messages from the sending network to the 
protocols used by the receiving network (with packets if 
necessary). When capitalized, the term "Internet" refers to 40 
the collection of networks and gateways that use the TCP/IP 
suite of protocols. 

The Internet has become a cultural fixture as a source of 
both information and entertainment. Many businesses are 
creating Internet sites as an integral part of their marketing 45 
efforts, informing consumers of the products or services 
offered by the business or providing other information 
seeking to engender brand loyalty. Many federal, state, and 
local government agencies are also employing Internet sites 
for informational purposes, particularly agencies which 50 
must interact with virtually all segments of society such as 
the Internal Revenue Service and secretaries of state. Pro- 
viding informational guides and/or searchable databases of 
online public records may reduce operating costs. Further, 
the Internet is becoming increasingly popular as a medium 55 
for commercial transactions. 

Currently, the most commonly employed method of trans- 
ferring data over the Internet is to employ the World Wide 
Web environment, also called simply "the Web". Other 
Internet resources exist for transferring information, such as 60 
File Transfer Protocol (FTP) and Gopher, but have not 
achieved the popularity of the Web. In the Web environment, 
servers and clients effect data transaction using the Hyper- 
text Transfer Protocol (HTTP), a known protocol for han- 
dling the transfer of various data files (e.g., text, still graphic 65 
images, audio, motion video, etc.). The information in 
various data files is formatted for presentation to a user by 
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a standard page description language, the Hypertext Markup 
Language (HTML). In addition to basic presentation 
formatting, HTML allows developers to specify "links" to 
other Web resources identified by a Uniform Resource 
Locator (URL). A URL is a special syntax identifier defining 
a communications path to specific information. Each logical 
block of information accessible to a client, called a "page" 
or a "Web page", is identified by a URL. The URL provides 
a universal, consistent method for finding and accessing this 
information, not necessarily for the user, but mostly for the 
user's Web '"browser". A browser is a program capable of 
submitting a request for information identified by a URL at 
the client machine. Retrieval of information on the Web is 
generally accomplished with an HTML-compatible browser. 

Web content is often dynamic because of various changes 
made by developers and other users publishing or making 
available web content, such as Web pages. Even static pages 
are occasionally updated. Web servers provide static content 
and dynamic content to various users. Static content contain 
data from files stored at a server. Dynamic content is 
constructed by programs executing at the time a request is 
made. The presence of dynamic content often slows down 
Web sites considerably. High-performance Web servers can 
typically deliver several hundred static pages per second. By 
contrast, the rate at which dynamic pages are delivered is 
often one or two order of magnitudes slower. 

Dynamic content is often present at a web site in an effort 
to provide customized pages and updated information to 
various users that may visit the site. The use of this type of 
Web page, however, may cause a web site to slow down in 
performance. 

Proxy caches are used to store data at sites that are remote 
from the server which originally provided the data. Proxy 
caches reduce network traffic and latency for obtaining Web 
data because clients can obtain the data from a local proxy 
cache instead of having to request the data directly from the 
site providing the data. This mechanism, however, does not 
work well with dynamic pages. One problem presented by 
dynamic pages cached in proxy servers is that it is essential 
for the cache pages to be current at all times, 

Therefore, it would be advantageous to have an improved 
or alternative mechanism for caching and handling dynamic 
content. 

SUMMARY OF THE INVENTION 

A data processing system comprising a cache memory, 
wherein a cache entry containing data is stored in the cache 
memory. A cache coordinator, wherein the cache coordinator 
invalidates one or more cache entries in response to a signal. 
An ID-based invalidation process, wherein a cache entry is 
associated with an ID that uniquely identifies the cache entry 
and can optionally be associated with one or more data ids 
that represent the underlying data contained in the cache 
entry, and the ID-based invalidation process sends a signal 
to the cache coordinator to invalidate all cache entries that 
either have that cache entry ID or have been associated with 
a data ID when the data that the ID represents changes. A 
time-limit-based invalidation process, wherein a cache entry 
can be associated with a time limit, and the timc-limit-based 
invalidation process sends a signal to the cache coordinator 
to invalidate a cache entry whose time limit has expired. A 
URI-based invalidation process, wherein all cache entries 
generated by a template with that URI are invalidated when 
that template changes. A URI is a Universal Resource 
Identifier that identifies a template that generates different 
cache entries. For example, a product display template might 
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have a URI named "productDisplay.jsp" that generate a page DETAILED DESCRIPTION OF THE 

for each product. The present invention integrates all of PREFERRED EMBODIMENT 

these methods of invalidation into a single system. „,.. t , , „ „„ „ , . 

^ ' With reference now to the figures, FIG. 1 depicts a 

BRIEF DESCRIPTION OF THE DRAWINGS $ pictorial representation of a distributed data processing 

The novel features believed characteristic of the invention ^ em ™ ^ the P resent mvention ™* «» implemented 

are set forth in the appended claims. The invention itself, Distributed data processing system 100 is a network of 

however, as well as a preferred mode of use, further objec- compute^ m which the present invention may be imple- 

tives and advantages thereof, will best be understood by men,ed : P^"? 6 ? P"*?™* ^tern WO contains a 

reference to the following detailed description of an illus- 10 netWOrk ^ w bich 15 med ™»> used to P r ™ de c °°™u- 

trative embodiment when read in conjunction with the °'caUons lmks between various devices and computers 

accompanying drawings, wherein: conned together within distributed data processing sys- 

^„ j T . ■ , . .. , lei n 100. Network 102 may include permanent connections, 

FIG. 1 depicts a pictorial representation of a distributed s „ ch „ ^ m fiber tic ^ Qr , connections 

data processing system in which the present mvention may made tbn)U ^ telepn0Ile connec tions. 

be implemented; 15 , . • , . , . 

« . ut , c j • . j • In the depicted example, a server 104 is connected to 

^ a 15 " ,h f 3 uT ^ T ^ P1 1 1 network 102 *»* with borage unit 106. In addition, clients 

accordance with a preferred embedment of the present m UQ ^ ^ ^ are % ogMd to a Qetwork 102 

mv i ™ 10 ^ . L1 , Jt J . . J . These clients 108, 110, and 112 may be, for example, 

FIG. 3 is a block diagram depicting a data processing personal computers or network computers. For purposes of 

system that may be implemented as a server in accordance mis application, a network computer is any computer, 

with a preferred embodiment of the present invention; coupled to a network, which receives a program or other 

FIG. 4 is a block diagram illustrating a data processing application from another computer coupled to the network, 

system in which the present invention may be implemented; l n the depicted example, server 104 provides data, such as 

FIG. 5 is a diagram illustrating examples of different 25 °oot ^^ es » operating system images, and applications to 

update rates and caching for pages depicted in accordance clients 108-112. Clients 108, 110, and 112 are clients to 

with a preferred embodiment of the present invention; server 104. Distributed data processing system 100 iucludes 

FIG. 6 is a diagram illustrating page fragments depicted a server system 114, which also may provide data to clients 

in accordance with a preferred embodiment of the present 108-112. Server system 114 may take various forms. For 

invention; 30 example, server system 114 may consist of two or more 

FIG. 7 is a diagram of metadata used to cache a fragment servers that have been logically associated with each other 

depicted in accordance with a preferred embodiment of the or ma y actually be interconnected as a cluster. Distributed 

present invention; data processing system 100 may include additional servers, 

FIG. 8 is a diagram illustrating statements for use in a clieats > aad other devices not shown - 

RequestDispatcher.include( ) method depicted in accor- 35 In the depicted example, distributed data processing sys- 

dancewith a preferred embodiment of the present invention; tem ^ me Internet with network 102 representing a 

FIG. 9 is a diagram illustrating instructions used to add a worldwide collection of networks and gateways that use the 

get cache method to a JSP depicted in accordance with a TCP/IP suite of protocols to communicate with one another, 

preferred embodiment of the present invention; At me heart of me Internet * a backbone high-speed data 

FIG. 10 is a diagram of instructions used in a service 40 communication lines between major nodes or host 

method depicted in accordance with a preferred embodiment computers, consisting of thousands of commercial, 

of the present invention- government, educational and other computer systems that 

^ . I c ion j • , j • * route data and messages. Of course, distributed data pro- 

MG. 11 is an example of a JSP depicted in accordance . , , . . . , r , 

... n , . j- . c t . r . . cessmg system 100 also may be implemented as a number 

with a preferred embodiment of the present invention; - ' . * *. 1 \. <* 1 

^ . - n .« . . L „. ^ 45 of different types of networks, such as, for example, an 

FIG. 12 is a data flow diagram illustrating the handling of mtranct> a bcal arca nctwork ( ^ 0f a ^ arca 

an external request from a chenl : for content depicted in BG t ^ inteQded ^ aD j ^ ^ ^ m 

m^en^ * e ^odiment of the present architectural limitation for the present invention . 

— « - ' . , . a j - . . «• fJi With reference now to FIG. 2, a block diagram of a server 

HG.13 is a data flow anagram showing handling of a data 5Q stem i& d ^ . Q accordance ^ a ferred embodi . 

ID or fragment ID invalidation depicted in accordance with meDt of me t mvention ^ * ^ ^ m 

a preferred embodiment of the present invention; Qf system ^ ma 5 /j lemented as 

FIG. 14 is data flow diagram illustrating aggressive rer- server system U4 m FIG ± Server system niustrates a 

endenng depicted in accordance with a preferred embodi- mec hamsm in which a web application achieves throughput 

ment of the present invention; 55 scak up md ^ availabilitVt In ^ s example, server system 

FIG. 15 is a data flow diagram illustrating data flow for 200 contains Web server nodes 202 and 204, which execute 

handhng an external request using multiple JVMs depicted Web application servers 206 and 208 respectively. The use 

in accordance with a preferred embodiment of the present 0 f fcc tcrm "server" may refer to either the physical data 

mvention; processing system or to an application providing receiving 

FIG. 16 is a data flow diagram illustrating handling a data 60 and processing requests from a client. Similarly, the client 

ID or fragment ID invalidation, as well as handhng time may be a physical data processing system or an application, 

limit expiration for a multi JVM system depicted in accor- For example, a client application would be a Web browser, 

dance with a preferred embodiment of the present invention; Server system 200 also includes a sprayer 210 which is 

and connect to Web server nodes 202 and 204. Sprayer 210 is a 

FIG. 17 is a data flow diagram flow for handhng aggres- 65 TCP/IP sprayer and acts as a cache that is external to Web 

sive rerendering using multiple JVMs depicted in accor- server nodes 202 and 204. A sprayer performs the function 

dance with a preferred embodiment of the present invention. of spreading requests to multiple webserver/application 
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server nodes. Not all sprayers have the proxy function. A With reference now to FIG. 4, a block diagram illustrates 

sprayer can also perform the function of a proxy server. The a data processing system in which the present invention may 

sprayer is closer to the client than the application server and be implemented. Data processing system 400 is an example 

it may contain its own cache. Sprayer 210 is used to of a client computer. Data processing system 400 employs a 

distribute HTTP requests evenly among the web servers, 5 peripheral component interconnect (PCI) local bus architec- 

such as Web servers located in Web server nodes 202 and ture. Although the depicted example employs a PCI bus, 

204. Sprayer 210 typically uses a time out to detect when other bus architectures such as Micro Channel and ISA may 

one of the Web server nodes can no longer respond, so it can be used. Processor 402 and main memory 404 are connected 

be taken off the sprayer's list of available nodes and a to PCI local bus 406 through PCI bridge 408. PCI bridge 408 

notification sent to an administrator. ^ also may include an integrated memory controller and cache 

Web server nodes 202 and 204 typically coordinate via memory for processor 402. Additional connections to PCI 
shared data (e.g., a distributed file system or database local bus 406 may be made through direct component 
system). These data mechanisms can themselves scaleup via interconnection or through add-in boards. In the depicted 
their own form of parallelism. In the depicted example, this example, local area network (LAN) adapter 410, SCSI host 
sharing of data is accomplished through shared parallel bus adapter 412, and expansion bus interface 414 are con- 
database 212, which contains an interconnect 214 providing 15 nected to PCI local bus 406 by direct component connection, 
a connection between storage devices 216-222. These stor- In contrast, audio adapter 416, graphics adapter 418, and 
age devices form a cluster and are shared by both Web server audio/video adapter 419 are connected to PCI local bus 406 
node 202 and Web server node 204. These storage devices bv add_in boards inserted into expansion slots. Expansion 
contain relational databases from which content is pulled by bus ^erface 414 provides a connection for a keyboard and 
Web server nodes 202 and 204 to dynamically create pages. 20 ^T^t^ t 2 °' modem and additional memory 
In this example, these pages are distributed to sprayer 210 ff A ^st bus adapter 412 provides a ' ™cUon for 
* i * hard disk dnve 426, tape drive 428, and CD-ROM dnve 430. 
for further distribution to clients. ™ . , nr ^ , , , * K . ' ... . 

^ , . mMt . Typical PCI local bus implementations will support three or 

The depicted configuration for server system 200 is four pa expansion slots or add . m connectors, 

intended as an example and is not meant to imply architec- ^ operating system ^ 0D proce ssor 402 and is used to 

rural limitations with respect to the present invention. coordinate and provide control of various components 

Referring to FIG. 3, a block diagram depicts a data within data processing system 400 in FIG. 4. The operating 

processing system that may be implemented as a server, such system may be a commercially available operating system 

as server 104 in FIG. 1, Web server node 202, or Web server such as OS/2, which is available from International Business 

node 204, in accordance with a preferred embodiment of the 3Q Machines Corporation. "OS/2" is a trademark of Interna- 

present invention. Data processing system 300 may be a tional Business Machines Corporation. An object oriented 

symmetric multiprocessor (SMP) system including a plural- programming system such as Java may run in conjunction 

ity of processors 302 and 304 connected to system bus 306. with the operating system and provides calls to the operating 

Alternatively, a single processor system may be employed. system from Java programs or applications executing on 

Also connected to system bus 306 is memory controller/ 35 data processing system 400. "Java" is a trademark of Sun 

cache 308, which provides an interface to local memory 309. Microsystems, Inc. Instructions for the operating system, the 

I/O bus bridge 310 is connected to system bus 306 and object-oriented operating system, and applications or pro- 

provides an interface to I/O bus 312. Memory controller/ grams are located on storage devices, such as hard disk drive 

cache 308 and I/O bus bridge 310 may be integrated as 426, and may be loaded into main memory 404 for execution 

depicted. 40 by processor 402, 

Peripheral component interconnect (PCI) bus bridge 314 Those of ordinary skill in the art will appreciate that the 

connected to I/O bus 312 provides an interface to PCI local hardware in FIG. 4 may vary depending on the implemen- 

bus 316 . A number of modems may be connected to PCI bus tation. Other internal hardware or peripheral devices, such as 

316. Typical PCI bus implementations will support four PCI flash ROM (or equivalent nonvolatile memory) or optical 

expansion slots or add-in connectors. Communications links 45 disk drives and the like, may be used in addition to or in 

to network computers 108-112 in FIG. 1 may be provided place of the hardware depicted in FIG. 4. Also, the processes 

through modem 318 and network adapter 220 connected to of the present invention may be applied to a multiprocessor 

PCI local bus 316 through add-in boards. data processing system. 

Additional PCI bus bridges 322 and 324 provide inter- For example, data processing system 400, if optionally 

faces for additional PCI buses 326 and 328, from which 50 configured as a network computer, may not include SCSI 

additional modems or network adapters may be supported. host bus adapter 412, hard disk drive 426, tape drive 428, 

In this manner, server 300 allows connections to multiple and CD-ROM 430, as noted by dotted line 432 in FIG. 4 

network computers. A memory-mapped graphics adapter denoting optional inclusion. In that case, the computer, to be 

330 and hard disk 332 may also be connected to I/O bus 312 properly called a client computer, must include some type of 

as depicted, either directly or indirectly. 55 network communication interface, such as LAN adapter 

Those of ordinary skill in the art will appreciate that the 410, modem 422, or the like. As another example, data 
hardware depicted in FIG. 3 may vary. For example, other processing system 400 may be a stand-alone system con- 
peripheral devices, such as optical disk drives and the like, figured to be bootable without relying on some type of 
also may be used in addition to or in place of the hardware network communication interface, whether or not data pro- 
depicted. The depicted example is not meant to imply 60 cessing system 400 comprises some type of network corn- 
architectural limitations with respect to the present inven- munication interface. As a further example, data processing 
tion. system 400 may be a Personal Digital Assistant (PDA) 

The data processing system depicted in FIG. 3 may be, for device which is configured with ROM and/or flash ROM in 

example, an IBM RISC/System 6000 system, a product of order to provide non-volatile memory for storing operating 

International Business Machines Corporation in Armonk, 65 system files and/or user-generated data. 

N.Y., running the Advanced Interactive Executive (AIX) The depicted example in FIG. 4 and above-described 

operating system. examples are not meant to imply architectural limitations. 
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For example, data processing system 400 also may be a re rendering) vs. infrequently avoiding a typically more 

notebook computer or hand held computer in addition to expensive activity (i.e., backend access). The processes of 

taking the form of a PDA. Data processing system 400 also the present invention may provide advantages for caching of 

may be a kiosk or a Web appliance. data and in particular for caching rendered pages, such as 

The present invention provides a method, apparatus, and S those in HTML format. Rendering occurs when a server 

instructions for caching dynamic content. The mechanism of template (eg, a JSP) is executed and it returns a format which 

the present invention is especially useful in caching Web can be read by its requester. Reader is an agent of the 

content, such as Web pages. In particular, the mechanism of requester which can display the rendering to its client 

the present invention may be used to provide caching for (another person or program). Readers would include HTML 

Web pages containing data having different rates of change. 10 browsers, Acrobat pdf viewers, or Internet agents. A frag- 

Turning to FIG. 5, a diagram illustrating examples of men! is rendered the first time by an external HTTP request 

different update rates and caching for pages is depicted in askm S for contents of a servlet/JSP/ASP/cgi program to 

accordance with a preferred embodiment of the present execute. Rerendering is the process of reusing the stored 

invention. FIG. 5 shows update rates for various types of request object to re-render the same fragment by 

pages as well as the type of caching that may be used. 35 re-executing the servlet/JSR 

Generally, caching is more beneficial as the access rate The change rate or update rate also determines whether 

increases and as the update rate decreases. All Web content dynamic content (via a template) should be used instead of 

is somewhat dynamic because everything changes static content. Static content requires redoing the pages and 

eventually, even static pages. For example, if content republishing the site wherever something changes. A 

changes very infrequently, then it is convenient for a human 20 dynamic content template goes to the database or file system 

to republish the Web site whenever its content changes. An to read tne & tesl data > formats it into HTML (called 

example of this type of content is a typical home page. It is rendering), and returns it to the client. For sites that have 

usually safe to enable browser and proxy server caching. something that changes often, dynamic content templates 

If content changes so often that it is unreasonable to makc tbe site manageable, 

republish the Web site every time it changes, then a template, With reference now to FIG . 6, a diagram illustrating page 

such as a Java Server Page (JSP), may be used to dynami- fragments is depicted in accordance with a preferred 

cally get the content from a file or database, and then render embodiment of the present invention. One mechanism pro- 

(i.e., format) the content into a HTML page. An ad service vided by the present invention to provide improved caching 

is an example of content that may change each time a page of content is to define content in a page as one or more 

is requested. A JSP and a servlet are both mechanisms, 30 fragments and cache the fragments individually, rather than 

which use Java standards for programming dynamic content. as a single page. 

A JSP is aimed at Web application designers and servlets are A fragment is a part or all of a rendered HTML page 

aimed at programmers. A JSP is compiled into a servlet for which can be cached. Afragment can contain 0 or more child 

execution. In this case, static caching in browsers and proxy 35 fragments, and can be contained by 0 or more parent 

servers may be disabled, and dynamic caching may or may fragments, forming a directed acyclic graph (DAG). FIG. 6 

not be useful. illustrates a returned page 600, which is a product display 

If the content is constant over a large number of requests, page. Page 600 is a "top-level" fragment made up of 5 child 

then performance can be significantly improved by using fragments. Page 600 includes a product gif URL fragment 

dynamic caching. Examples of content that is fairly consis- ^ 602, a product detail fragment 604, a personalized greeting 

tent are products in e-commerce and white pages as shown fragment 606, a shopping cart fragment 608, and an ad 

in FIG. 5. With dynamic caching, either time limit or a data service fragment 610. The fragments depicted in FIG. 6 are 

ID invalidation mechanism can be used to keep the content shown in order of increasing rate of change for the under- 

in the cache up to date. One way to view this case is that it lying content in the fragment with product gif URL 602 

automates the publishing process so that high update rates 45 having the slowest rate of change and ad service fragment 

can be handled. 610 having the fasted rate of change. Product gif URL 

If the content changes continuously, such as, for example, fragment 602 contains a hypertext reference (HREF) that 

a ticker tape, any form of caching is a bad idea because specifies the URL of the file for an image that shows what 

caching overhead is suffered with no benefit. the product looks like. 

JSPs may be used to generate a page containing this 5 0 Product detail fragment 604 in this example may be a 

content without any caching. formatted table that includes the detailed description of the 

Caching rendered HTML content offers performance product with details, such as the product order number, 

improvements when the underlying dynamic content has not name > options, and price. Personalized greeting fragment 

changed. One performance improvement is avoiding access 606 is a fragment including a greeting that is directed 

to backend servers to get the dynamic content. The access 55 towards the user, such as, for example, "Hello, John! Wel- 

avoided to backhand servers includes, for example, access- come to Acme Corp.". Shopping cart fragment 608 in this 

ing a database, a transaction monitor, an internal application, example is a formatted shopping cart, including the order 

or a news service. Additionally, rendering the dynamic number, name, quantity and price of the products that have 

content into HTML is avoided. been chosen for possible purchase. 

Caching the underlying dynamic content (i.e., data) 60 A(1 service fragment 610 includes a HREF for an image 

instead of HTML requires rendering the data into HTML that displays an advertisement. The advertisement href is 

during the fast path (i.e., when there is a cache hit). different each time a page is sent to a shopper. This makes 

However, the fast path occurs more often. When the same page 600 as a whole too volatile to cache. However, frag- 

data is rendered in multiple ways, caching rendered HTML ment granularity allows the other portions of page 600 to be 

requires accessing the backend server once for each render- 65 cached. 

ing. The tradeoff is difficult to make because it is between The HREF to the product image in product gif URL 

avoiding a typically less expensive activity (i.e., fragment 602 and the detailed product description in product 
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detail table fragment 604 are excellent candidates for frag- fragment. Reasons for choosing the "pinned" option might 

ments to be cached because the underlying data of a par- be real-time requirements or the fact that the web developer 

ticular product changes infrequently. However, the underly- knows better than a LRU algorithm, 

ing data .of some product changes far too frequently for static Aggressive rerender 710 is metadata that is used to 

publishing. s indicate whether to aggressively rerender a fragment when 

The personalized greeting in personalized greeting frag- it is invalidated or when its time limit expires, instead of 

ment 606 has the lifetime of a user session, but only for a waiting for an external request that needs the fragment With 

particular shopper It may be used several times within a this aggressive rerender option, either a time limit or data ID 

fairly short time interval. Thus, personalized greeting frag- invalidation may cause the value of fragment 700 to be set 

ment 606 is a good candidate for dynamic caching. Shop- 1Q t0 null and fa gm(tQi 1D 70 2 to be put on a queue to be 

ping ,cart fragment 608 changes multiple times within a user rere ndered when idle time permits. When this option is 

session (every time something is added or the quantity ^ off a ^ ^ Qf data ID mvalidatio / causcs 

changes), so it is no as good a candidate for dynamic fra 700 (o be remQved from ^ be 

^ 2f " 7* f g ' ' T' H°f *™ dcrcd ■*» F* back in the cache only when needed by 

cart fragment 608 xs included on every page returned to the ^ ^ 

shopper, then shopping cart fragment 608 is typically A . S 1 . . tL ... 4 . r 

returned several times between changes, so there is a rea- Aggressive rerendenng can exploit the idle time of the 

sonable case for caching it. The advertisement HREF in ad * erver b J renderin ? P a * es in a back e r °™ d ™« of 

service fragment 610 is a poor candidate for caching because °^ on * smular 10 automatin g Polishing process, 

the hit ratio would be zero and caching has its own overhead Data 10 712 ma y be uscd to ** x data IDs mat ^present the 

(i.e., storing it in the cache and invalidating it). Of course, 20 ^deriving data which cause the fragment to be invalidated, 

each child fragment may contain additional fragments. Fragment 700 can use zero or more pieces of data, so that 

Turning next to FIG. 7 a diagram of metadata used to fragment 700 can have zero or more data IDs. Apiece of data 

cache a fragment is depicted in accordance with a preferred can be used * one or f a <*? ta ID can nave 

embodiment of the present invention. Fragment 700 is „ one or more fragments. When the raw 

stored in a cache, which is referred to in these examples as 25 dat y a 10 1S , Vf e 10 mVahda f e £ me fra S raeDts mat d lP end on 

a "fragment cache". In FIG. 7, fragment 700 includes a fAT bc ^ <f mc S <*P C as j hc fragment 

fragment ID 702, which identifies fragment 700 within a * D * ™ en a £ ie ?! 15 T * l ° Y * m ^ ' 

fragment cache. Fragment ID 702 is selected to be unique data 10 can bc mc samc as ID " 

within a fragment cache. Tnis uniqueness may be with w In ^ ; d ^cted example, the fragment ID will always be 

respect to a process within a server (if each server process 30 one of d ^ IDs. When a piece of data is used in multiple 

has its own fragment cache instance), a server (if a fragment fragments, its data ID would be different from either of the 

cache instance is shared across the processes within a fragment IDs. A database trigger might be used to create the 

server), or a cluster of servers (if a fragment cache instance cxtcrnal eveQt ^ initiates the invalidation, 

is shared across multiple nodes in a cluster). A fragment ID, „ Fragment 700 also includes time limit 714, which is 

such as fragment ID 702, is typically computed using metadata mat may be used to set a maximum time limit that 

processes on a JSP template. Fragment ID 702 can be the fragment 700 should be cached without its value being 

URL, the URL plus some request attributes, or not directly updated. The time granularity is configurable. For the web 

related to the URL. developer, this is simpler than setting data IDs because there 

Fragment ID 702 can be used to enforce security by 4n are no triggers to write. However, it causes many fragments 
adding user information. The above example of a product to bc disca ^ cd ^ d rerendered when they are actually still 
description fragment does not enforce security. It uses an ID vahd * A ne S aUve value that no ^ Umit exists " 
that includes the fact that it is a product detail fragment and Next > exte mal cache group 716 may contain an ID for a 
the product order number (e.g., u productDetail-TA23434"). S rou P of external caches that are written to when a page- 
However, if shopper groups are supported that have different 45 level fragmea 1 is rendered or invalidated. A page level 
prices and/or a different subset of the products, then the ID fragment is invalidated when the page fragment is invali- 
might also include the shopper group (e.g., "productDetail- dated. 

SG188-TA23434"). placing this additional information in Fragment 700 also contains value 718 which is the cached 

fragment ID 702 prevents a shopper that is not in the shopper rendering of the fragment. For a fragment that contains child 

group from simply changing the URL to obtain or access 50 fragments, the fragment can be stored in the cache in either 

cached information, provided the cache is accessed within °f mc following forms: 

the application after authentication. With each child fragment fully expanded. 

Fragment 700 also contains a URL 704, which is the URL With each child fragment represented by a link to the child 

relative to the server for this fragment. For a top-level fragment which can be expanded when the parent is 

fragment (e.g. a JSP that is externally requested), this could 55 returned. Each link includes both the child's fragment ID 

be obtained from the HTTP request object's URL. For a and URL. The fragment ID is needed to expand the child in 

contained fragment, this is the JSP file name URL. the case when the child fragment is in the cache. The URL 

Fragment 700 also contains a cache it 706 indicator, is needed to expand the child in the case when the child 

which is metadata identifying whether the fragment should fragment is not in the cache. The advantages of the linked 

be cached. Cache it 706 allows a runtime decision about 60 representation are: 

whether a particular instance (fragment) of the JSP should be Reduced storage because the child fragments are not 

cached. For example, on a product display JSP, it may be replicated. 

known that products from a certain category are either The parents does not have to be invalidated when a 

accessed too infrequently or changed too frequently to be contained child is invalidated. 

cached worthwhile caching. 65 The child fragment's cache access frequency statistics are 

Next, pinned 708 provides an option of allowing least more accurate because the child is accessed from the cache 

recently used (LRU) replacement to be applied to the each time it is used. 
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All of the above caching metadata illustrated in FIG. 7 is only a selected group. For example, the product description 

supplied in the cached fragment's JSP. This information is pages may be different for different shopper groups. With an 

supplied using a Fragmentlnfo object, which is a simple external cache, authentication is not performed except for 

struct object. firewall enforcement, so the pages must be accessible to 

Application tailorable ids are also provided for in accor- 5 everyone within that security domain, 

dance with a preferred embodiment of the present invention. A Web application server of the present invention includes 

All of the ids are determined by the application. For an internal cache that can also push results of selected pages 

example, a cache entry for a product display page might ^ external caches. This mechanism allows a decision at a 

have the form of "productDisplay-TA23724", where the ' SP *f m P late ^ ff""^ to be made as to whether that 

"productDisplay-" part is the same for all product display io ! em ? la e w ° uld ^ F^** an external cache versus an 

a *if OTA^TiiH- * *u • j • * j i j * it\ * internal cache. Those templates that satisfy the above con- 

pages and the TA23724 is the individual product ID that ^ ^ ^ c P ost . pcrformance y advantagc of „ 

is different for each product. extemal cache 0ther templates could ^ me flexibility of 

The API for including in a page another servlet, another the internal cache. In the figures described below, a mecha- 

JSP or an HTML file is a RequestDispatcher.include( ) nism for implementing internal and external caches are 

method. A JSP that uses caching would be called using this 15 illustrated in accordance with a preferred embodiment of the 

same mechanism. The called JSP contains all of its own present invention. After a page has been rendered, the 

caching metadata. resulting fragment is pushed to the cache coordinator. The 

With reference next to FIG. 8, a diagram illustrating cacnc coordinator looks at the "externalCacheGroupId" of 

statements for use in a RequestDispatcher.include( ) method the fragment. If the cache group is a valid cache group 

is depicted in accordance with a preferred embodiment of 20 defined in mis environment, then it will push the fragment 

the present invention. The statements in FIG. 8 represent to J hc cact *? ™ cacheGroup. Mapping of 

instructions that are added to a JSP that is to be cached. externalCacheGroup ID to a hst of all adapters that are a part 

„ T . , , „^ rt .„ of that externalCacheGroup. As elements are pushed to the 

With reference now to FIG. 9, a diagram illustrating various external caches, some mformation is maintained to 

instructions used to add a get cache method to a JSP is M invalidate. This information includes, for example, mapping 

depicted in accordance with a preferred embodiment of the 0 f fragment data IDs to URLs and mapping of URIs 

present invention. These instructions are used to allow the (templates) to URLs. Both are used to invalidate a large 

JSP to obtain a cache ID. Next, in FIG. 10, a diagram of number of rendered pages in the external caches depending 

instructions used in a service method is depicted in accor- on either data IDs or their template (URI). FIGS. 12-14 

dance with a preferred embodiment of the present invention. 3Q provide illustrations of data flow used in caching dynamic 

The service method is the code that is executed in a content for Web applications. The examples in FIGS. 12-14 

JSP/servlet when an HTTP (do post, do get) request is sent. are all described with respect to a single Web application 

The service method contains the logic to "render" a page. server (WAS) Java virtual machine (JVM). Java™ is an 

Turning now to FIG. 11, an example of a JSP is depicted object oriented programming language and environment 

in accordance with a preferred embodiment of the present 35 focusing on defining data as objects and the methods that 

invention. JSP U00 includes instructions for defining meth- may be applied to those objects. Java supports only a single 

ods on servlets, which can be called to obtain the ID of the inheritance, meaning that each class can inherit from only 

page before the rest of the page is cached or run. "<%! %>" one other class at any given time. Java also allows for the 

defines a function to return the "cache ID" of this instance creation of totally abstract classes known as interfaces, 

given an HTTP request and response. This will be called ^ which allow the defining of methods that may be shared with 

before any rendering happens. "<% %>" defines the rest of several classes without regard for how other classes are 

the metadata for the fragment When caching fragments, two handling the methods. 

types of locations may be used, an extemal cache and an The Java virtual machine (JVM) is a virtual computer 

internal cache. A wide variety of caches exist that are component that resides only in memory. The term "JVM" is 

external to the web application server. For example, external 45 a Java specific term for "address space". As used herein, 

caches may include those in a web server, operating system, JVM is interchangeable with "address space". The JVM 

and a sprayer. In the depicted examples, an internal cache is allows Java programs to be executed on different platforms 

a cache that is part of the web application server engine. as opposed to only the one platform for which the code was 

When a JSP template page containing requests for dynamic compiled. Java programs are compiled for the JVM. In this 

content is executed, the resulting rendered fragment is 50 manner Java is able to support applications for many types 

cached. of data processing systems, which may contain a variety of 

An external cache offers better cost-performance than a central processing units and operating systems architectures, 

web application server which supports the flexibility and To enable a Java application to execute on different types of 

protection required for application code. An external cache data processing systems, a compiler typically generates an 

can even be supported in data processing systems that do not 55 architecture-neutral file format — the compiled code is 

have the overhead of an operating system (e.g. multiple executable on many processors, given the presence of the 

processes/threads, memory management). Also, extemal Java run time system. The Java compiler generates by tecode 

caches are closer to the client. These type of systems can instructions that are non-specific to particular computer 

have a very large cost-performance advantage. architectures. A bytecode is a machine independent code 

The advantages of an internal cache include fragment go generated by the Java compiler and executed by a Java 

granularity that can be exploited. For example, if part of a interpreter. 

page is too volatile to cache, the rest of the page can still be A development environment, such as the Java Develop - 

cached. With an external cache, only whole pages, also ment Kit (JDK) available from Sun Microsystems, Inc., may 

referred to as fragments can be cached. Consequently, these be used to build Java byte code from Java language source 

pages cannot contain content that is too volatile to cache. $5 code and libraries. 

A further advantage of an internal cache is that access Timing now to FIG. 12, a data flow diagram illustrating 

control can be enforced, causing a page to be accessible to the handling of an external request from a client for content 
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is depicted in accordance with a preferred embodiment of With reference again to step e5, if the HTML content is 

the present invention. In running a JSP, the JSP is compiled cached, JSP 1204 does not have to be executed and the cache 

into a servlet and the servlet is compiled into a class file if content may be returned to the calling entity requesting the 

a compiled servlet is not more recent than a corresponding Daec 
JSP 

™1 , TOT1 . j , 5 JVM 1200 also includes an invalidation daemon 1214 and 

™, 4 a fv^fni^ .L 3 " "'TSf a rerender daem ° n m6 > whose functions will be described 

request for a page received in JVM 1200 by JSP engine 1202 . f , , „ l ^ , . . t . 

(step el). This request in the depicted example is a more detail below. m request is made, the 

Re q uestDispatcher.include( ) request in a HT1P format. This reC * UeS floWS throu ^ * e y < f cm f 1 Cache resourc ^ before the 

request may be received from a client or from another JSP in rc< *? cst makes ll to mc Wcb a PP" ca u°n server. The external 

in JVM 1200. JSP engine 1202 then calls a getCacheld cache resource ^ K ^ it has the value the request is 

method on JSP 1204 (step e2). In this example, with the Poking for and return it to the client instead of burdening the 

HTTP request, JSP 1204 is a top level JSP, which may Web a PP llcatlon ««ver from rendering or retrieving it from 

contain a HTML in line or may contain request to include a me WAS cache. 

static HTML, Java code to dynamically generate HTML, or Turning next to FIG. 13, a data flow diagram showing 

request execution of another JSP using the handling of a data ID or fragment ID invalidation is depicted 

RequestDispatcher.include( ) method. in accordance with a preferred embodiment of the present 

JSP engine 1202 receives a response from JSP 1204 (step invention. In this example, time limit daemon 1210 main- 

e3). The JSP engine tries to determine whether the HTML tains a ^ of fragments and time limits for expiration. In 

content is cached from the returned response. This determi- ^ mcse examples, a change to a value in a fragment results in 

nation is made by sending a get value request to fragment f 11 u P dat ^ t0 a time limit for the fragment. This update 

cache 1206 (step e4). The request for the value is made using includes increasing the expiration time to be equal to the 

the response returned from JSP 1204. A response is returned current time remaining phis the time limit for the fragment, 

by fragment cache 1206 to JSP engine 1202 (step e5). If Ia omcr implementations, other mechanism may be used, 

cached content is not present in a response from fragment M For example, the current time remaining may be reset to the 

cache 1206, JSP 1204 is executed by calling the JSP's time limit. 

service method (step e6). Step e6 occurs without executing In FIG. 13, time limit daemon 1210 wakes periodically to 

step e4 if the response returned in step e3 is null. see if any fragments have expired. If a fragment has expired, 

In response, JSP 1204 accesses a relational database time limit daemon 1210 sends an invalidation signal to 

(RDB) 1209 to obtain dynamic content by sending a mes- 30 cache coordinator 1208 (step tl). Upon receiving notifica- 

sage to RDB 1209 to obtain raw content (step e7). This tion that a fragment's time limit has expired, cache coordi- 

message may be, for example, an SQL query or a call to nation 1208 sends a call to the caches to indicate that the 

stored procedure. RDB 1209 may be located, for example, fragment is no longer valid. In this example, cache coordi- 

at a back end server. A response is returned containing the nator 1208 sends an invalidate message to fragment cache 

raw or dynamic content (step e8). JSP 1204 will then render 35 1206 (step t2), which results in a response or reply being 

the dynamic content into a HTML format. Once the render- returned to cache coordinator 1208 (step t3). The message 

ing has been performed (logic in the servlet/JSP has been includes the fragment ID. In addition, cache coordinator 

executed) the fragment contains both the value (the 1208 sends an invalidate page message to external cache 

rendering) and the metadata required to maintain the frag- adapter 1212 (step t4). A response also is returned by 

ment in the cache. The resulting HTML content is sent to 40 external cache adapter (step t5). These responses indicate the 

JSP engine 1202 by JSP 1204 (step e9). In rum, this content success or failure to invalidate the fragment. Cache coordi- 

is placed into fragment cache 1206 by JSP engine 1202 (step nator sends a reply back to time limit daemon 1210 (step t6). 

elO). Fragment cache 1206 then calls cache coordinator Additionally, a data ID or fragment ID invalidation may be 

1208 to write the fragment for handling by cache coordina- initiated by calling either fragment cache 1206 or cache 

tor 1208 (step ell). Cache coordinator 1208 functions to 45 coordinator 1208. A JSP, such as JSP 1204, has access to its 

maintain all of the caches in synchronization. l° ca l fragment cache, fragment cache 1206, using a static 

If the fragment has a time limit, cache coordinator 1208 variable and may send a call through JSP engine 1202 to 

will send an update message to time limit daemon 1210 with invalidate a fragment (step jl). The fragment cache imple- 

the new value to update the expiration time (step el2). A ments this call by forwarding the call to cache coordinator 

response is returned by time limit daemon 1210 to cache 50 1208 (step j2). At that point, steps t2-t5, as described above, 

coordinator 1208 (step el3). occur t0 invalidate the fragment. 

If the fragment is for an external cache, then the page is If data is updated by a source other than JSP 1204 within 

written to an external cache adapter 1212, which results in JVM 1200, then the use of a database trigger for invalida- 

the HTML content being sent to an external cache (step el4). tions is employed in the depicted example. In accordance 

The fragment may be assigned to a cache group. In such an 55 with the preferred embodiment of the present invention, a 

instance, the fragment is written to each cache in that group. database trigger is employed by inserting a record into 

External cache adapter 1212 is a local adapter object that validation table 1300 in the database in RDB 1209. The 

encapsulates the protocol used by the external cache. In record in this example includes a time stamp column 1302 

other words, external cache adapter 1212 serves as an and a data ID column 1304. The time stamp in time stamp 

interface to the external cache or caches. A response is 60 column 1302 will indicate when the trigger record was 

returned by external cache adapter 1212 to cache coordina- created in invalidation table 1300. The data ID in data ID 

tor 1208 (step el5). This response indicates whether the column 1304 represents the data that has been updated, 

write was successful. The response is then sent to fragment Data IDs can refer to whatever granularity is appropriate, 

cache 1206 (step el6), which in turn is sent to JSP engine In the above example, an update to a product record with a 

1202 (step el7). The HTML content is then returned to the 65 primary key of "TA23434" would trigger inserting a record 

party sending the RequestDispatcher.include( ) message in the invalidation table with an data ID of "product- 

(step el8). TA23434". 
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Invalidation daemon 1214 is a thread that runs periodi- JSP 1204 will accesses a relational database (RDB) 1209 

cally to perform a cache invalidation algorithm each time it to obtain dynamic content by sending a message to RDB 

wakes up. Invalidation daemon 1214's only state is the latest 1209 (step r4). RDB 1209 may be located, for example, at 

timestamp it has already processed and the length of its wake a back end server. A response is returned containing the raw 

interval. Invalidation daemon 1214 reads records from 5 or dynamic content (step r5). JSP 1204 then renders the 

invalidation table 1300 in RDB 1209 (step il). The records dynamic content into a HTML format. The resulting HTML 

read from invalidation table 1300 are those where the content is sent to JSP engine 1202 by JSP 1204 (step r6). In 

timestamp is greater than the latest timestamp it previously taxD * ^ contcnt ^ P lace ^ into fragment cache 1206 by JSP 

processed. For the above example, the record with a data ID en S^f 1202 ( S ^P ^ Fragment cache 1206 then calls cache 

of «product-TA23434" would be found in response to read- 10 c °ordinator 1208 to write the fragment for handling by 

ing invalidation table 1300 in step il. The results are 5"*? ; «™*aa»?r ^1208 (step r8). Cache coonginator 1208 

returned to invalidation daemon 1214 (step i2). functions to maintain all of the caches in synchromzaUon^ 

...... .... , ., . . If the fragment has a tune limit, cache coordinator 1208 

Invalidation daemon 1214 sends a notification to cache sends an updatc messag6 10 Ume jjritdiemon m0 with the 

coordinator 1208 to invalidate any fragments with the speci- new value to date the expiration time (step r9 ). Aresponse 

fied data ID (step i3). As a result, cache coordinator 1208 15 ^ retumed by (imc limi , dacmon 1210 ^ £^ 

performs steps t2-t5 as described above. Aresponse is sent fsten rl($) 

from cache coordinator 1208 to invalidation daemon 1214 rft ! / \ . - ^ . . tl _ t , 

/ . t *t_ j ■ * j i iL c . . It the fragment is for an external cache, then the page is 

£ CP I ,n « T *, T P 2™- gD ?HK v ™ tl ™ '° ™ adapter 1212, which resulte in 

fragment ID was productDetail-TA23434" would be mvah- u^jn M + > u • . 1 u / > n\ 

dated 20 HTML content being sent to an external cache (step rll). 

The fragment may be assigned to a cache group. In such an 

Further, invalidation daemon 1214 will remember the instance, the fragment is written to each cache in that group. 

latest timestamp in the retrieved records. Invalidation dae- External cache adapter 1212 is a local adapter object that 

mon 1214 will sleep for a configured interval before awak- encapsulates the protocol used by the external cache. A 

ing and performing the process again. ^ response is returned by external cache adapter 1212 to cache 

With respect to rerendering fragments, if a fragment's coordinator 1208 (step rl2). This response indicates whether 

aggressive rerender option is not set and an invalidation the write was successful. The response is then sent to 

occurs, it is simply removed from the cache as soon as it is fragment cache 1206 (step rl3), which in turn is sent to 

no longer pinned as indicted by pinned metadata associated rerender daemon 1216(step rl4). 

with the fragment. If the aggressive rerender option is set 3Q The processes of the present application as described with 

and an invalidation occurs, the fragment's value is set to null respect to FIGS. 12-14 are in the context of a single JVM. 

and its fragment ID is put on a queue to be rerendered as These processes also may be applied to multiple JVMs 

soon as it is no longer pinned. For all fragments invalidated located on one or more servers. FIGS. 15-17 illustrate the 

by a single invalidation notification, all of their values are set software structure and data flow for dynamic content cach- 

to null prior to any being put on a rerender queue, so that 35 ing for web applications when multiple JVMs handle exter- 

inconsistent fragments are avoided. The rerender queue is nal requests. These JVMs may all be on the same node or 

located inside the FragmentCache. The fragment cache is can span multiple nodes. 

responsible for adding and removing elements from the With reference now to FIG. 15, a data flow diagram 

queue. A configurable number of rerender threads are illustrating data flow for handling an external request using 

present, which look in the queue to determine which frag- 4Q multiple JVMs is depicted in accordance with a preferred 

ments they can possibly render. The queue only contains embodiment of the present invention. In this example, a 

cache IDs which have been rendered by this fragment cache coordinating JVM 1500 is present and will interact with Web 

and can be rerendered by this cache. To be able to rerender application server (WAS) JVM 1502. Coordinating JVM 

a fragment, its request object is copied and saved in the 1500 includes a cache coordinator 1504, a render coordina- 

fragment cache along with the rest of the fragment's caching 45 tor 150 6, a fragment cache 1508, an external cache adapter 

metadata. The request object is saved only when the aggres- 1510, a time limit daemon 1512, and an invalidation daemon 

sive rerender option is set. The request object is a sta ndard 1514, WAS JVM 1502 contains a JSP engine 1516, JSP 

Servlet object, which encapsulates all the data of the HTTP 1518) a fragment cache 1520, and a render daemon 1522. In 

request made by the client. Analogous objects are present in this example, although a single WAS JVM is shown for 

cgi or ASP. The request object contains information on the SQ pur p 0ses 0 f describing data flow, coordinating JVM 1500 

URL and parameters that were pass ed in the remote client may handle multiple WAS JVMs in accordance with a 

machine as well as contents of the HTTP header (referring preferred embodiment of the present invention, 

page, what browser is calling, etc.). Thc cxccution of a JSP ^ by ^ mcoming 

'nirnmg next to FIG. 14, data flow diagram illustrating request for a page received in WAS JVM 1502 by JSP engine 

aggressive rerendering is depicted in accordance with a 55 1516 (step el). This request in the depicted example is a 

preferred embodiment of the present invention. Rerender RequestDispatcher.include( ) request in a HTTP format JSP 

daemon 1216 is a thread normally running at low priority. engine 1516 then sends a get value call to fragment cache 

Rerender daemon 1216 will monitor the rerender queue for 1520 (step e2). In turn, if the fragment needed for the request 

work to perform. When items are present on the rerender is not located within the fragment cache 1520, a read 

queue for processing, rerender daemon 1216 will increase its 60 fragment call is sent to cache coordinator 1504 within 

priority to normal. Rerender daemon 1216 sends a call to coordinating JVM 1500 (step e3). Cache coordinator 1504 is 

fragment cache 1206 to rerender the fragment (step rl). used as a cache coordinator for all the other JVMs. Cache 

Next, in response to the call to fragment cache 1206 to coordinator 1504 is checked to see if the fragment is present 

rerender the fragment, fragment cache 1206 sends a request, because the fragment may have been rendered by another 

RequestDispatcher.include( ) to JSP engine 1202 (step r2). 65 JVM (not shown) other than WAS JVM 1502. 

In turn, JSP engine 1202 will request the content by sending Cache coordinator 1504 sends the read fragment request 

a service call to JSP 1204 (step r3). to render coordinator 1506 (step e4), which in turn sends the 
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request to fragment cache 1508 in coordinating JVM 1500 cally to see if any fragments have expired. Time limit 

(step e5). A response is returned by fragment cache 1508 to daemon 1512 will send an invalidation signal to cache 

render coordinator 1506 (step e6). If the response does not coordinator 1504 (step tl). 

include the fragment, render coordinator 1506 marks the Upon receiving notification that a fragment's time limit 

fragment as rendering work-in-progress. A response is then 5 has expired, cache coordinator 1504 will send a call to the 

sent back to cache coordinator 1504 (step e7). The response caches to indicate that the fragment is no longer valid. In this 

generated by the render coordinator will include either the example, cache coordinator 1504 sends an invalidate mes- 

fragment or an indication that the fragment was absent from sage to fragment cache 1508 (step t2), which results in a 

cache 1508. response or reply being returned to cache coordinator 1504 

In turn, the response is sent to fragment cache 1520 in 10 (step t3). Cache coordinator 1504 also sends an invalidate 

WAS JVM 1502 (step e8). If a fragment is present in this message to fragment cache 1520 in JVM 1502 (step t4). A 

response. The client cache will receive a fragment from the reply as to the results of the request is turned to cache 

second level fragment cache if it is available at that second coordinator 1504 from fragment cache 1520 (step t5). In 

level. If the fragment is found, then the client cache will put addition, cache coordinator 1504 sends an invalidate page 

the fragment in its cache. This response is returned to JSP 15 message to external cache adapter 1510 (step t6). A response 

engine 1516 (step e9). If the response indicated that a also is returned by external cache adapter (step t7). These 

fragment was absent, then the JSP is executed. The JSP is responses indicate the success or failure to invalidate a the 

executed by calling the JSP's service method (step elO). If fragment. Cache coordinator sends a reply back to time limit 

the fragment was present, the fragment is then returned to daemon 1512 (step t8). 

the caller requesting the content. More than one fragment 20 Additionally, a data ID or fragment ID invalidation may 

might be returned to the caller as a page or in other case, the be initiated by calling either fragment cache 1520 or cache 

fragment may make up the entire page. coordinator 1504. A JSP, such as JSP 1518, has access to its 

JSP 1518 accesses relational database (RDB) 1526 to local fragment cache, fragment cache 1520, using a static 

obtain dynamic content by sending a message to RDB 1526 variable and may send a call through JSP engine 1516 to 

(step ell). A response is returned by RDB 1526 containing 25 invalidate a fragment (step jl). The fragment cache 1520 

the raw or dynamic content (step el2). JSP 1518 then implements this call by forwarding the call to cache coor- 

renders the dynamic content into a HTML format. The dinator 1504 in JVM 1500 (step j2). 

resulting HTML content is sent to JSP engine 1516 by JSP At that point, steps t2-t7, as described above, occur to 

1518 (step el3). In turn, this content is placed into fragment invalidate the fragment. 

cache 1520 by JSP engine 1516 (step el4). 30 A database trigger for invalidations is employed in the 

Thereafter, fragment cache 1520 then calls cache coordi- depicted example. In accordance with a preferred embodi- 

nator 1504 to write the fragment for handling by cache ment of the present invention, a database trigger is employed 

coordinator 1504 (step el5). The fragment is sent to cache by inserting a record into validation table 1600 in the 

coordinator 1504 to allow other JVMs to access the frag- 35 database in RDB 1526. The record in this example includes 

ment. Cache coordinator 1504 in turn sends the write a time stamp column 1602 and a data ID column 1604. The 

fragment request to render coordinator 1506 (step el 6), time stamp in time stamp column 1602 will indicate when 

which in turn sends the request to fragment cache 1508 (step the trigger record was created in invalidation table 1600. The 

el7). A response to the write fragment request is returned to data ID in data ID column 1604 represents the data that has 

render coordinator 1506 (step el8). If the response indicates 4Q been updated. 

that the fragment was successfully written, the fragment is As mentioned above with respect to validation in a single 
unmarked as a rendering work-in-progress. The response is JVM, data IDs can refer to whatever granularity is appro- 
then passed on to cache coordinator 1504 (step el 9). priate. 

If the fragment has a time limit, cache coordinator 1504 Invalidation daemon 1514 is a thread that runs periodi- 

will send an update message to time limit daemon 1512 with 45 cally to perform a cache invalidation algorithm each time it 

the new value to update the expiration time (step e20). A wakes up. Its only state is the latest timestamp it has already 

response is returned by time limit daemon 1512 to cache processed and the length of its wake interval. Invalidation 

coordinator 1504 (step e21). daemon 1514 reads records from invalidation table 1600 in 

If the fragment is for an external cache, then the page is RDB 1526 (step il). The records read from invalidation 

written to an external cache adapter 1510, which results in 50 table 1600 are those where the timestamp is greater than the 

the HTMLcontent being sent to an external cache (step e22). latest timestamp it previously processed. The results are 

The fragment may be assigned to a cache group. In such an returned to invalidation daemon 1514 (step i2). 

instance, the fragment is written to each cache in that group. Invalidation daemon 1514 sends a notification to cache 

External cache adapter 1510 is a local adapter object that coordinator 1504 to invalidate any fragments with the speci- 

encapsulates the protocol used by the external cache. A 55 fied data ID (step i3). As a result, cache coordination 

response is returned by external cache adapter 1510 to cache performs steps t2— 17 as described above. A response is sent 

coordinator 1504 (step e23). This response indicates from cache coordinator 1504 to invalidation daemon 1514 

whether the write was successful. The response is then sent (step i4). In the depicted example, the fragment whose 

to fragment cache 1520 (step e24), which in turn is sent to fragment ID was "productDetail-TA23434" would be invali- 

JSP engine 1516 (step e25). The HTML content is then 60 dated. 

returned to the party sending the Further, invalidation daemon 1514 will remember the 

RequestDispatcher.include( ) message (step e26). latest timestamp in the retrieved records. Validation daemon 

Turning now to FIG. 16, a data flow diagram illustrating 1514 will sleep for a configured interval before awaking and 

handling a data ID or fragment ID invalidation, as well as performing the process again. 

handling time limit expiration for a multi JVM system is 65 Turning now to FIG. 17, a data flow diagram flow for 

depicted in accordance with a preferred embodiment of the handling aggressive rerendering using multiple JVMs is 

present invention. Time limit daemon 1512 wakes periodi- depicted in accordance with a preferred embodiment of the 
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present invention. When WAS JVM 1502 is idle, rerender to fragment cache 1520 in WAS JVM 1502 (step z23). A 

daemon 1522 will increase its priority and identify a number response is returned to JSP engine 1516 for the set page call 

of pages or fragments that are present in the rerender key for in step zl8 (step z25) with a response to call page being 

processing. This identified list of fragments is sent to frag- returned (step z26). Thereafter a response to the rerender 

ment cache 1520 (step zl). This list includes the fragment S request is sent to rerender daemon 1522 (step z24). 

IDs along with the identification of WAS JVM 1502 in the The present invention also incorporates a way to manage 

depicted example. Fragment cache 1520 forwards this list to failed software components. When the cache coordinator 

cache coordinator 1504 (step z2), which in turn is forward sends a message to the internal or external caches, it uses a 

to render coordinator 1506 (step z3). Render coordinator timeout when waiting for the reply. If the cache does not 

1506 processes the IDs for the fragments to determine 10 respond within the timeout, the cache coordinator assumes 

whether a fragment within the list is in a rendering work- the cache is no longer working, so it stops sending messages 

in-progress list. The work-in-progress list is maintained by to the cache and sends a notification to a systems adminis- 

render coordinator 1504 in these examples. Additionally, trator saying that the cache is not functioning, 

render coordinator 1506 determines whether the fragment is ^ a coord i natin g JV M can significantly improve 

present in fragment cache 1508 by sending a query to 15 efficiency in a multi-JVM or multi-node configuration. This 

fragment cache 1508 (step z4). The query includes the efficiency is provided by adding a single coordinating JVM 

fragment ID. A response is returned by fragment cache 1508 mat contains a single cache coordinator, time limit daemon, 

(step z5). invalidation daemon, and a render coordinator. Adding a 

If the fragment is absent from fragment cache 1508 and is rendering coordinator with its own fragment cache in the 

not identified in the render work-in-progress list, render 20 coordinating JVM reduces the number of renderings from 

coordinator 1504 returns that fragment ID to the JVM that once per WAS node to once for all WAS nodes. This includes 

sent the fragment ID, WAS JVM 1502 for rerendering both database access and rendering overhead, 

through cache coordinator 1504 (step z6). The fragment ID A sul gi e invalidation daemon significantly reduces the 

for rerendering is sent to fragment cache 1520 from cache number of database accessed. In addition, a single invali- 

coordinator 1504 (step z7). 25 daUon d^mon md time umit daemon keeps the WAS JVMs 

Next, in response to the fragment ID from cache coordi- in synch, so that a change shows up across all WAS JVMs 

nator 1504, fragment cache 1520 sends a request, at the same time. This avoids users seeing inconsistent 

RequestDispatcher.include( ) to JSP engine 1516 (step z8). results. A single invalidation daemon and time limit daemon 

In turn, JSP engine 1516 executes JSP 1518 by calling a reduces the number of messages for invalidations, 

service method (step z9). JSP 1518 will access a relational 30 Further, having the cache coordinator and time limit 

database (RDB) 1526 to obtain dynamic content by sending daemon in the same JVM reduces messages by piggyback- 

a message to RDB 1526 (step zlO). A response is returned m g me notification of a changed fragment value from the 

containing the raw or dynamic content (step zll). JSP 1518 WAS JVM to the TimeLimitDaemon on the write fragment 

then renders the dynamic content into a HTML format. This message from the WAS JVM to the CacheCoordinator. 

content becomes the value of the fragment after the servlet/ wim this centralizalioi]) me data flows described above in 

JSP has finished executing. The fragment metadata is cur- FIGS 15 _ 17 for a multiplc JV M system with a coordinating 

rently supplied by the JSP that is executed. The JSP engine JVM flows mtT from a single system as described in 

provides some information to the fragment to tell it when a pj GS \2r-\4 in the following ways: 

page is being inserted and when new request attributes are XX J , , , « ien ' . , , , . 

a a a t*i« u- im/f * * • «* too • 4Q When rendered locally, the JSP engine puts it back m the 

added. The resulting HTML content is sent to JSP engine . . „ 4 - . , ; AA . ^f* * , %t , . ™„ 

iei ,, TcmeioA "i i\ t * *u- * 1 a local FragmentCache (steps el4 m FIG. 15 and zl6 m FIG. 

1516 by JSP 1518 (step zl2). In turn, this content is placed ~ ^ , „ , i « , . 4 , ~ , « 

• 4 , . u v / ien . I*** / * *7i<*\ 17)- The local FragmentCache sends it to the CacheCoor- 

mto fragment cache 1520 by JSP engine 1516 (step Z13). ^ £ nG FIG. 10), so that 

Fragment cache 1520 sends the figment .to then call cache ^ ^ can . Fof ^ cache 

coordinator 1504 to write the fragment for handling by j- . i_ i_ * j • <u • i nA« j 

u a' * *et\A * i\r** leSn/ * 71j) v 45 coordinator behaves as it does in the single JVM case and 

cache coordinator 1504 m JVM 1500 (step Z14). ., , , . , « v 

v * ' writes the fragment value aggressively (steps e22 in FIG. 15 

The fragment is sent to render coordinator 1506 (step ^ m in FIG 15) For fragment cacheSj the cache coor- 

zl5), which in turn writes the fragment into fragment cache dhiator behaves differently than in the singje JVM case and 

1508 (step zl6). A response as to the success of this write can prov jd e a second-level cache. The cache coordinator can 

operation is returned to render coordinator 1506 (step zl7). 5Q have [{s own fr agment cach e 7 ^ch ^ t0 increase 

This response is relayed to cache coordinator 1504 (step performance as illustrated in FIGS. 15 and 17. Also, the 

z l*0* cache coordinator can keep a table of which WAS JVMs, 

If the fragment has a time limit, cache coordinator 1504 which have rendered which fragments. The cache coordi- 

sends an update message to time limit daemon 1512 with the nator can obtain a fragment out of the appropriate WAS JVM 

new value to update the expiration time (step zl9), A 55 when the fragment is requested. The advantage of this 

response is returned by time limit daemon 1512 to cache approach is reduced memory. This feature is an alternative 

coordinator 1504 (step z20). to keeping the fragments in the coordinating JVM's frag- 

If the fragment is for an external cache, then the page is ment cache, 

written to an external cache adapter 1510, which results in Further, when the JSP engine tries to find the fragment in 

the fragment being sent to an external cache (step z21). The 60 the local fragment cache and the fragment is absent from the 

fragment may be assigned to a cache group. In such an local fragment cache, the fragment cache will try to find 

instance, the fragment is written to each cache in that group. needed fragment in the cache coordinator (step e3 in FIG. 

External cache adapter 1510 is a local adapter object that 15) because the fragment may have been rendered by 

encapsulates the protocol used by the external cache. A another WAS JVM. If the fragment is not found in either the 

response is returned by external cache adapter 1510 to cache 65 first or second level fragment cache, the render coordinator 

coordinator 1504 (step z22). This response indicates will mark the fragment as a work-in-progress and expect the 

whether the write was successful. The response is then sent first level cache to send it the fragment upon rendering (step 
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elO in FIG. 15). A first level fragment cache is the fragment 
cache that is owned by the local application server process. 
The second level fragment cache is owned by the render 
coordinator in the multi-jvm scenario. With a coordinating 
JVM, only the single CacheCoordinator notifies the time 
limit daemon that a value has been updated (steps e20 in 
FIG. 15 and zl9 in FIG. 15). This effectively piggybacks this 
notification on the write fragment message (steps el5 in 
FIG. 15 and zl4 in FIG. 17), taking advantage of the fact that 
all changes in fragment values goes through this coordinat- 
ing JVM. 

When a WAS JVM is idle, its rerender daemon asks its 
fragment cache to render the first N pages on the local 
rerender queue (step zl in FIG. 17). The fragment cache 
forwards this via the cache coordinator (step z2 in FIG. 17) 
to the render coordinator to volunteer for rerendering work 
(step z3 in FIG. 17). The render coordinator processes these 
IDs in order, checking to see if the fragment is in the 
rendering work-in-progress list or in the central fragment 
cache (step r4 in FIG. 10). If the ID is in neither, it returns 
that fragment ID for rerendering. The WAS JVM's fragment 
cache can assume that all IDs prior to the returned ID in the 
fist have already been rerendered, so its local rerenderQueue 
can be updated accordingly. If an ID was returned, the WAS 
renders that fragment (step z8 in FIG. 17) and returns it to 
the RenderCoordinator (steps zl4/zl5 in FIG. 17) and goes 
back to sleep. 

As described above for the depicted example, the render 
coordinator assigns a WAS JVM to render a fragment in 
either of two ways. First, a WAS JVM asks for a fragment 
and it is not centrally available. This request returns null for 
the fragment value, indicating that the WAS JVM should 
render it locally. Second, an idle WAS JVM volunteers to 
rerender any of a list of fragment IDs and the RenderCoor- 
dinator returns one of these ID, indicating that the WAS 
JVM should render it locally. The render coordinator keeps 
track of any pending render jobs until they are done, so that 
the same one is not assigned to more than one WAS JVM. 
This centralized render coordination scheme does not need 
to copy across nodes the complex server state required to 
render or rerender a fragment. 

Instead, the scheme always uses a WAS JVM that already 
has the required server state that is saved from an external 
request. The render coordinator can use a time out when 
waiting on a pending render job to be completed, so that a 
WAS JVM that has died does not cause problems for the rest. 

It is important to note that while the present invention has 
been described in the context of a fully functioning data 
processing system, those of ordinary skill in the art will 
appreciate that the processes of the present invention are 
capable of being distributed in the form of a computer 
readable medium of instructions and a variety of forms and 
that the present invention applies equally regardless of the 
particular type of signal bearing media actually used to carry 
out the distributioa Examples of computer readable media 
include recordable-type media such a floppy disc, a hard 
disk drive, a RAM, and CD-ROMs and transmission-type 
media such as digital and analog communications links. 

The description of the present invention has been pre- 
sented for purposes of illustration and description, but is not 
intended to be exhaustive or limited to the invention in the 
form disclosed. Many modifications and variations will be 
apparent to those of ordinary skill in the art. For example, 
although the depicted examples involved content in the form 
of HTML pages being requested over the Web using HTTP, 
the present invention may be used in other environments. 
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For example, the process may be applied to other types of 
content, such as pages using extensible markup language 
(XML). Also, the sever processes do not have to reside on 
JVM'S. Although the depicted examples are directed 
towards a JVM, the mechanism for the present invention 
may be applied to address spaces in other program language 
environments. Additionally, although the depicted examples 
show a particular sequence of writing to an internal cache 
and an external cache, the sequence of writing to internal 
and external caches may occur at any order or simulta- 
neously. The embodiment was chosen and described in order 
to best explain the principles of the invention, the practical 
application, and to enable others of ordinary skill in the art 
to understand the invention for various embodiments with 
various modifications as are suited to the particular use 
contemplated. 
What is claimed is: 

1. A data processing system comprising: 

a cache memory, wherein cache entries are stored in the 
cache memory; 

a cache coordinator, wherein the cache coordinator invali- 
dates cache entries in the cache memory in response to 
a signal; 

a first ID-based invalidation process, wherein the first 
ID-based invalidation process sends a signal to the 
cache coordinator to invalidate a cache entry in the 
cache memory based on a cache entry ID; 

a second ID-based invalidation process, wherein the sec- 
ond ID-based invalidation process sends a signal to the 
cache coordinator to invalidate cache entries in the 
cache memory based an associated data ID whose data 
changes; and 

a time-limit-based invalidation process, wherein the time- 
limit-based invalidation process sends the signal to the 
cache coordinator to invalidate a cache entry in the 
cache memory in response to a presence of an expired 
time limit for the cache entry. 

2. The data processing system of claim 1 further com- 
prising: 

a universal resource identifier based invalidation process, 
wherein the universal resource identifier based invali- 
dation process sends the signal to the cache coordinator 
to invalidate a cache entry in the cache memory in 
response to a change in a template with that URL 

3. The data processing system of claim 1 further com- 
prising: 

an external cache adapter, wherein the cache coordinator, 
responsive to the cache entry being stored in an exter- 
nal cache, sends signals to the external cache to invali- 
date the cache entry through the external cache adapter. 

4. The data processing system of claim 3 further com- 
prising: 

a server engine, wherein the server engine processes 
requests for pages and sends an invalidation signal to 
the cache coordinator. 

5. The data processing system of claim 1, wherein the 
cache entry is invalidated in the cache memory by a template 
without directly using the cache coordinator. 

6. The data processing system of claim 1, wherein a data 
structure is a database. 

7. The data processing system of claim 1, wherein the 
cache memory, the cache coordinator, the first ID-based 
invalidation process, the second ID-based invalidation 
process, and the time-limit-based invalidation process are 
executed by a Java virtual machine. 
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8. The data processing system of claim 1, wherein the 
cache memory is located in a first Java virtual machine and 
the cache coordinator, the first ID-based invalidation 
process, the second ID -based invalidation process, and the 
time-limit-based invalidation process are located in a second 
Java virtual machine. 

9. The data processing system of claim 1, wherein the data 
comprises a plurality of cache entries. 

10. The data processing system of claim 1, wherein the 
second ID-based invalidation process sends the data ID as 
the signal. 
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11. The data processing system of claim 1, wherein the 
cache memory includes a plurality of cache entries and 
wherein the signal is the cache entry ID. 

12. The data processing system of claim 1, wherein the 
signal originates from a template in the data processing 
system. 

13. The data processing system of claim 1, wherein the 
cache memory contains a plurality of cache entries and 
wherein the cache coordinator associates cache entries in the 
cache memory using both the cache entry ID and at least 
zero data ids. 
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